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ABSTRACT 


Optimall control of systems governed by delayed- 
aifferential equations is®explored by using the control 
theory developed for systems governed by ordinary differential 
equations. A simple algorithm for producing a suboptimal 
control law with restricted feedback is presented. Two 


examples illustrate the computational method. 
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mo) LNT RODUC DON 


A. DELAYED-DIFFERENTIAL EQUATIONS 

In many physical systems, such as rocket engines [1,2], 
antirolling stabilization systems for destroyers [3] and 
pipeline recycling systems for chemical reactors [4], the 
most accurate mathematical representation of system 
dynamics is found to be a matrix system of differential 
equations with fimite time delay in the arguments of some of 


the state variables. 


x(t) = Ax(t) + Bx(t —-t) + Cu(t) Gin) 


05% (0) Rehan Cae 6) 
CG) CE CE) 5 | SIS 10 ce) 


Equations of this form have been known as differential- 
iiinmoreice.  Nysterodimierential, functional differential, 
Guitiercntial with transport lag, differential with deviating 
Sroumcios maigmar lavyed—Giigmerenvial eyuations, to name gust 
emtew. Hor the@purposes of this! research, equations of the 
form of (1) are referred to as delayed-differential 


equations. 


Bee [HE OPTIMAL REGULATOR PROBLEM 

The research to be described is concerned with a solution 
ei che! opramaimeimseulator problem. ~Simply stated; this 
problem seeks the control function u*(t) (a member of the 


set of admissible controls u(t)) which minimizes a quadratic 





COSsuml UNevpilon of thesiform 


co 


NGC) x(t), utc) ) is J Lee! Ce ARIS) sew Ge MRR Cech 1 (sy) 


subject to the constraints of equations (1) and (2). Qisa 


né pPOSitivessemidefinite matrix; KR is a a POSi tive definice 


TE Wit a Ae jal 


C. NOTATION 
Notation follows that established by Bryson and Ho [5]. 
Mm general, 1t is asgiollows: 


il COtummemmectorss are denoted by Lower case letters: 
Sine LeASUosewapheds lower @ease shel tersearegelements of 
vectors. 


Pee (2 Lr eecomome Indic aucd by Upper Cases letters. = Doubly 
subsecripted lower case letters represent eléments of 
a Ma vied 


3. Matrix transpose is indicated by the prime symbol('). 
Roch Gor. LOW? Cmca Vemma fronephbesreneradime rules 
established above. 


Ve represeMmemuhne sea batasindependens Variable time. 


pet «Cenovecwune scalar time delay, possibly a function 
Ole Lime and Sbalvemvariab les: 


ped 1S aAmoccllaremllicwlonm Olemalrices. 


4H. The lower case letters i1,j,2jm, and n are used as 
tinge x iipeee wilaoLes 


VaeLoe tetar derivativemis indicated ey da. 
6. A damped natural frequency is represented by Ws 


D. PROBLEM STATEMENT 
ee - eC TlOn 
imehuision of the delay term t in the state variable 


equation greatly complicates solution of the optimal 





moo UNALOm Drool eiiwae ne Wel Sstablirsncad = bncory. ol ordinary 
differential equation systems can not be applied with 
equation (1). In addition, although the necessary theory 
and computational procedures have been developed [6] for 
computation of the optimal control law, implementation of 
that law is often found to be either impractical or undesir- 
able. Implementation of the optimal control law requires 
mecdback OL 2 COMiginUUM Ome sual, Cb Um Ge CCU a 
which are often not readily available from the system being 
eomveroliled. 
2. Purpose 

The purpose of this research is to develop a method - 
for approximating the optimal control law for delayed- 
differential systems by utilizing the optimal control 
meiinieracron Col Ordinaryealtlerencvial sySteMmS wae ln addition, 


pas limpler algorithm 1S offjered for restricted feedback cases. 


EB. BACKGROUND 

ae cene raul 

Anderson and Soudack [7] indicate that the study of 

the delayed-differential equation appears to have started 
with John Bernoulli in 1728, but most presently available 
information has been published since 1940. Bibliographies 
published by R. Weiss [8] in 1959 and Chosky [9] in 1960 
contain references to more than 350 separate papers dealing 
with the delayed-differential equation and associated 
Dreblems. ie annotated bibliography by R. Weiss surveys 


English language papers published between 1935 and 1958. 





The work by Chosky is supplemental to the bibliography of 
Weiss and covers the period of 1916 to 1959, including 
reference to numerous foreign language papers. 

Prior to 1960, several papers were published which 
addressed the problem of approximating the delay term so 
Poauecne Cesired control, law could be obtained. 

In a paper published in 1940, Mason and Philbrick [10] 
devised a liquid level analog to a thermal process with time 
lag. This model was used to examine response to various 
iypes of control ays nee. A related work by Ziegler and 
Nichols [11] considered various control settings for auto- 

Do MmiCmc Onc POL Cimeultls Wich process lain. The Qevlmal conurol 
was determined from the area under a state tTime-history 
curve. Bretoi [12] and Minorsky [3] used first order differ- 
ential equations to approximate control systems with time 
aoe @LeCre CoewGontrolm lawewas devVermined from the 
aeproxiMav LOM ,eune actual System was. adjusteaqrto cive.the 
desired results. 

in aneaetempe tor,explain why,eunder certain circum=— 
stances, a pendulum began to spontaneously oscillate with a 
moaediuency higher bhaneits. Own damped naturall frequency or 
that of the externally applied forcing function, Minorsky [13] 


expressed the system model as j 
x, (t) + a,x, (t) + b,x, (t-t) + ce, x, (t) = 0 (4) 


Considering the time delay term T to be small, x,(t-t) was 


eepanded inmablaylorgsecrics "to yield 


LO 





nt” 
) —— 


(-1 n! 


(n+1) F . 
Hor very large m and small Tt this expression Gonverges to a 
term of the form Sige Replacing the delayed term in equation 


(4) by e~? the following system model was obtained: 


x, (t) = (a, - 


—O ° 2 
1 bie ) x, (t) -+ ce, x, (t) = 0 


This equation was studied to determine regions of stability. 

The major work in the theory of delayed-differential 
equations has been undertaken since 1960. This increasing 
emphasis may in part be attributed to the rising application 
of such equations to automatic control systems as well as 
tine development of high speed computers. 

eee Deve looument of Lhneory 

Bellman [14] and El'sgol'ts [15] discussed the 
existence and uniqueness of solutions to equations of the 
amc) BOT al | jm 

Krosovskii [16], appears to have been one of the 
earliest developers of an optimal control formulation for 
une Winear quadratic probllem with time delays an the states. 
meeMourn New tave mo explicic detinivicns for the parameters 
required to actually determine the optimal control law; the 
feedback was in the form of a linear combination of the 


SAL CS EE LeNGLOn. of Fontryadan S macmnupeer inci ole Ue 
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systems with multiple delays was accomplished by Kharatishvii 
[17,18]. These works have served as a basis for numerous 
other papers on differential-difference equations. Orguz-~- 
toreli [19], Chyung and Lee [20] have also worked with the 

Se Tivavlonsolenecessary COndivionseior G@ptimality in the 

Horm oLsthne maximum principle. 

Ross and Flugge-Lotz [6] developed an optimal linear 
eoneGol law, Similar in form to Krosovskii"s!, for’a® system 
in which the time delay had been normalized to one. (In a 
later work, Ross [21] showed that a system with any number 
of delay terms can be transformed into a system with one 
delay which can be normalized to one.) This paper also 
presented the sufficient conditions for the existence of 
molmics lO Mes control functions and sulficient conditions fox 
a linear control law to be optimal. Kushner and Barnea [22] 
showed that a linear control law for (1) subject to a qua- 
dratic cost function in the form of (3) was optimal with 
fmeaeeect CO thewclass Of Square integrable control laws, af 
ines SOlULI CMO @lyewasmconLinuous. 

poe Approximavion of Dellayed-Di fifierential Bduatvions 

Because of the complexity of solving the optimal 
regulator problem when the system dynamics involve delayed- 
daprerenvial equations, considerable effort Dacor 
directed toward approximating the delayed-differential 
equation by systems of ordinary differential equations. 

Repin [23] has shown that equation (1) can be 
approximated to any desired accuracy by a series of 


differential equations. 
ie 





For systems in which the delay term is small, Jen- 
Wei [24] developed a procedure for replacing the delay term 
a A series of pilece-wise linear functions which lead to 
a system of linear state variable equations with no time 
delay. Hess [25] has extended this procedure to a system 
in which the delay was not restricted. 

Results similar to those obtained by Ross and Flugge- 
Lotz [6] were developed by Soliman and Ray [26,27] by 
apomeximating whe delay with 7m arbitrarily large seu offi 
differential equations. Similar procedures have been used 


by Westdal and Lehn [28] for a related problem. 


1s 





LTS thon Opeth OPTIMAL GONTROL OF 
DELAYED-DIFFERENTIAL SYSTEMS 


A. EXISTENCE AND UNIQUENESS 


HOrsan equation Of Meno ol Own sf orm. 


Ce) Sable sel esis = ce) 


x(t ) Ot) amet mes. Cacaat 


0 


Gee acces 0 


t 


El'sgol'tts [15] has shown that if the functions f, $6, T are 


econ OUs ear neCmsO UL 1ON C€xiSts ~a lf jlmaeaddi tion 


df 
Ewes 





af ag (ty 
? Nes Coie Ge : 








age mmounded Imethe vicinity Of the initial value (a@ Lipschitz 
Condition in x(t)), then the®slolution Usaliso unique. 
Since it has been shown [6] that the optimal control, 


Pr) ee oP en sume form 
-] 0 
u*(t) = -R-C'[K)x(t) + J K, (8) x(t + 6)d0] 
-T 
i ae solution to the optimal regulator problem (equations 1-3) 


existe amdeisp monique if the above Lipschitz condition is 


Su tom Led. 


14 





B. CONTROLLABILITY 

L. Weiss [29] developed algebraic sufficient conditions 
for delayed-differential equations with time varying COC tiles 
elents to be controllable. These conditions reduce to the 
eudanaly saleebralc criteria for controllability as the delay 
Beeoncomac? ligib le. lhe papers presenus aemetnod "for scompuvine 
Mmiomeolumns for the Controllability matrix. 

Considering a system with constant coefficients, Hewer 
[30] has shown that if the system in which t+0 is control- 
fag bem chien they dalayed eee en 15 Conerollablewmor amy 
meee. Theyconverse’ of this statement is not always true. 
For the time invariant case, the results obtained by Weiss 


can be reduced to those obtained by Hewer. 


Cee DE VELOPMENTOOF THE OPTIMAL CONTROL LAW 

Ross and Fligge-Lotz [6] and Ross [21] have developed 
the optimal control law for equation (1) subject to (3) as 
Lollows ; 

i 6 hones le Control 

fe (1) as controllablewethe set ef admissible control 

functions, u(t), are those measureable functions in L,{0,°] 
match yielLdwaetanite value for (3) for any set of initial 
ond cons Gee 


Pee Suiticwent Conditions for a Linear Feedback 
GontroleLaw eto be Optimak 


The optimal control law of (1) subject to the cost 
Funetion (3) and a specified get of initilal condition 


homer .ons (2) is of the form 





a 


0 
ut(t) = -ROC'(K x(t) + Jf K,(0)x(t + 6)a6] (5) 
Tt 


Boe O(c) eek) eet oe 0 


al 5 
a. u*(t) is a stable control law (admissible in this case) 
De. Ko (a symmetric positive definite matrix), K, (8) and 


K,(8 5c) Satisfy the following relationships 


é 


al 


A'Ky ge py Race Cea ae K,' (0) + K, (0) + ) = © (6) 
ak, (@) , 1. 

ap «= (AT - KACR“C')K, (6) + K,(0,8) -7<0<0 (7) 
0K, (6,7) oK.(6 57) : = : 9 
iL a oo (8) 

Po < GS Ore cu 

gee = K,8 (9) 
K,(-1, 6) = B'K, (8) (10) 


If B=0, equivalent to a system with no delay term, the 
above conditions reduce to the familiar algebraic Riccati 
equation. The first term in u*(t) is the optimal control 
law for the undelayed system; the second and more complicated 


irnm eteeounts for the’ addition of the delay term. 


16 





Uidewmmecne abeve CONdIiLIionS, the quadrabve cost function 
(3) can be expressed in terms of the initial condition 


Bunction 2). 
0 
J(,u*) = $'(0)K,6(0) + 26'(0) Jf K,(6)6(@)d0 
sori 


0 0 
+ f f o'(0)K,(6,0)6(e)dazde (11) 
cand Ot 8 


Although the control law, Ueto ee lS POD ta amenor am arbavrary 
Herel becOndi tion Tunction wilemeis) cometnuousily ditferenti 
able, the value of (3) is, as would be expected, a direct 
function of the initial conditions. 
pee OLaDLIIty of the Optimal Contmo lL Law 

im Ordeiece apply the @pvuilmaleconerol law, some 
approximate method of computation is required. Once the 
eontrol law is calculated, there is no known algorithmic 
method by which#the stability of the control can be 
assessed [6]. Determination of stability requires that the 
miescd) Loop syseemn performance be Adnvestigatedsformamsel of 
inttial condition functions large*enough to cover those 
exoected to beMencountered by the control system. If no 
Micsvdmmemoonoaverer 15 detected, the control) lawacan be 


assumed to be stable in that particular application. 


ati 





ive: PRHOegie Py lONSORSTHEeerTIMALSCONTROL LAW 
BLORaDELAGED-DLEBEERENTIAL S4s2EMS 
he APPROAIMATHON OF DELAYED-DIFFERENTIAL EQUATIONS 
Repin [23] has shown that equation (1) can be approxi- 
Mawecmovm@amscCrTeSmol cOoUaly Lona decvermaned by defining 42 new 


set of state variables. The state variables are defined as 


Follows: 
x, *(t) Selim, 
Se OM os => 
Cheon 
x(t) = x(t - — 
me Co) =| pee) 


ine nemiieis a DOswtive interer eCual vowGr preater thaniiwo, 
x, *(t) is a nxl column vector composed of the elements of 
moe ori einal statve® velcvtor. 

Usinessimple forward difference formulas for estimaving 


derivatives, the following set of equations can be developed: 


ive 





ep Shai) ikea Ge) aate OCs) 


ko¥(t) = (x, (tb) - x#(t)) Bob 
. : (13) 
ke#(t) = Ory 7 (t) - x, #(t)) St 
KH(t)= (x, a(t) - xp (t)) oe 


‘ 


ose Ser eee Ot ft irs “Orden I neac ined 1 heren ile 


Sduaweens can be shown to be expressible as 





y(t) =A y(t) +, ult) (14) 
where 
A 0 0 B 
eT Te 0 e+ 0 
i (15) 
Na 0 (m1) ; xml) 0 
Om T T 
(ies 
0 0 0 —- I 
Q 0 0 C 
eee () 0 
of Cr = ale (16) 
0 0 0| 0 


il 





x, *(t) 


x5 *(t) 


y(t) = . (17) 
x, *(t) 


x bt) 


Repin has shown that by selecting m large enough, 
equation (1) can be approximated to any degree of accuracy 
eesimeg, @nd in the "limit as m+« |, the representation 
presented above becomes exact. 

B. OPTIMAL AND SUBOPTIMAL CONTROL OF 
ORDINARY DIFFERENTIAL SYSTEMS 
For the Cime invariant linear system of differential 


equations 
at) eens iat) Ct) em 2 0 em c(.C)) ao 


With a Quadratic cost function in the form of (3), the opti- 


mal control law has been shown to be 


ei Rt Co! Vere) (18) 


Cy 


where) V is the symmetric positive definite) solution to the 


MCC Orane@nCeab. CQuaviten 


VAy + AgtV- VC Rt 


0 0 CF cater a 10 (19) 


20 





When the optimal control law is applied, the value of 


the cost function (3) can be expressed as 
J = o' Vo 


Elkind and Falb [31] have shown that if some control 
tecyes —G X(t) (G is a matrix of constants conformal to x(t)) 
is applied, instead of the optimal control law (18), the cost 


function can be expressed as 
= 1 1 
Jn = O' Vo d > O' VE (20) 


further, if the eigenvalues of (Ay - Cy G) havewmesat ive mice a | 


acts, Vo is the symmetric positive definite solution to 


—1 


m t = 1 = 
(Ay Cy G) Vo “5 Vo lAg Cy G)+ G'R G+ Qo 0 aly) 


These expressions can be used to determine the value of 
(3) for any stable feedback composed of a linear combination 


Si asvates. 


C. APPROXIMATION OF THE CONTROL LAW 
It has been shown that (1) can be approximated by a 


system of differential equations 


y(t) = Ap y(t) + Cou(t) 3; t > 0 (a> 


i 
| 
v 
ct 
i 
S 


y(t) 


with y(t), y(t), Ap, and Cy as defined by (12-17). The 


Mature becoOmaitlon Matrix is 


oa 





¢ (0) 


= il 


$ = GT” (23) 
o(-T) 


mnowcost function is 


I(y(0),y(t),u(t)) = f Ly'(t) Qo y(t) + ul(t) Ru(t)] dt 
O 


(24) 


The hypothesis here is that an accurate approximation to 
the optimal control law (5) for the delayed-differential 
system (1) can be obtained from the optimal control law (18) 
for an ordinary differential system. This ordinary differen- 
tial system is, of course (22), the one which approximates 
the delayed-differential system (1). 

Rigorous prool of this hypothesis iisvditficult. Instead, 
the following section shows that this approximate method is 
exactly equivalent to the computational approximation which 
Ross ULI zes in solving for his optimal control law for 
system (1). 

D. EQUIVALENCE OF COMPUTATIONAL APPROACHES* 

i nOcso sic Liod 


In order to compute the optimal control law (5), 


Ross [21] replaces the conditional equations (6-10) by 


*For convenience, and without loss of generality, the 
time delay tT has been normalized to unity in the discussion 
which follows. 


ge 





finives difference formulas on the surface -1 S70 5 0G 


sims 2 Oe The resultingsequations are 


a 


A'Ky + Ky A- Ky CR C' Ke © Ky 40) tk oD + Q*= 0 (25) 
-(i-1) sal it = ' -lay =e) 
a (Sa7] - (er ]} [ata] = {4" - moor er} ey [SSM] 
=(420) 
+ Kp (0, oe 
ie 2 Smeal (26) 
-~(i-1) -(j-1) -i -(j-1) 
{Kp m= 1 Zi m-1 Ko [= z m—1 | 


ae 
J A 
}-- 
J A 
T 
— 


(27) 


ie: 
| A 
qa 
A 
i 
jas 


K, (-1) = K,B (28) 
Ke, [2 ; =" = Bi kK, =a we ee Sd (29) 


Pelee. G. and®R the same matricés®appearing in (1) and 


[py 
23 





Now for the same value of the integer m, let K be the 


positive semidefinite solution of the algebraic Riccati 


equation 
-l 
1 = _ 
A-l Kor Ad K Oot R one Ket Qa] Q (30) 
where 
A Q Q CO ta B 
(m-1)I —(m-1)I Q oa eee Q 
Al = Q (m-1)I —(m-1)I ie Q 
Q 0 Q (m-1)TI —-(m-1)I 
Q 0 0 6 
Q Q ; Q 0 
Sn 1 ~ Cm—1 ~ : (31) 


oO 
S 
ro) 

= 
Oo 

i 


eis themnmeen identity matrix, A and Q,_, are square 


m—-1 


matrices having n x m rows and columns, and C,_, is nxm by 2) 


If one considers the (symmetric) matrix K to consist of 


m* sub-blocks, K,,, for 0 <i <m-1, and 0 <j <mil, of 
|G team ol 
oe | eal eee 1 
OMe ste mn ae 
Ke rss? Am-1 m-1| 


then (30) becomes a set of algebraic equations in the unknowns 


ve 
IJ 21 





Ross then pointis out that iif one dissects (30) and 
compares those algebraic relations with the algebraic rela- 
tions (25-29), the two sets of equations are found to be in 


direct correspondence. Specifically: 


0 mi 050 (33) 
K = = (m-1) K | 

1 | (m-1) O,itl ° O<i <m-2 
Kj (-1) = Ky & = qa * (34) 


seal = - 2 
Ke ty > Gal | = (m-1) Slag na 5 YUSis<m-2 and 
QO< 


2 = : 5) 2 ety | > a = na: 


K., — ' -1| = «(=| B O<i<m-l Ga 


Thus, solution of the Riccati equation (30) is equivalent 
GO SOlution of equations (25-29). Since efficient algorithms 
ors Vani LE Demse LUuUloOrneet maeccati equations @f this form, 
Ross bases [TeomcOnpivallond  maapproacm on vhe Solution of 


equation (30). Interpolation between the resulting values™ 
14 
m-1 
i,j = 0,1,...,m-l1 , yields approximations to Kj, K,(@) and 


a ee 


-i 
Ton se ss < mia and «(= 4 ai 


ce Oke K, | m1 


K,(¢,8) iMmmecua tions (5) and (liye The computation is 


25 





mermManavea When Ne Sigenificanvl improvement in the approxi- 
iat leommof Kos K, (8), K,(,8) aortas as mis increased. 
feeeCe MeUnOgsoLr 1ecu1on Lit, C. 
Una ompeehocmowimrhabethe OplLimal tcontrol law Yee 


eZ evwitheamcoss funeeron of the torm (24) is 


~~ 


u*(t) = -R Cy! Vy(t) (36) 


where V is the solution of the Riccati equation 


At'V+vVA. -vec.R tc 


0 0 ‘ 9 V+ Q) = 0 (37) 


V is a symmetric (n x m)* matrix Composed seu me sub-blocks 


Vag: 


a (38) 


Loewy auc wien em cose imnCtton ) dist Siiven by 
Ja" hay (39) 
Equations (36) and (39) can be rewritten 


m 
eee) an (40) 


-1 


u¥(t) = -R Cyt {Vv 


26 





m 7 
J = $'(0) Vj, o(0) + 2 '(0) Lo aEeo FSi 
L= 
ee (lies i-jJ 
. ny oh ea) Vs: Ess a 
or 
m-1 


u(t) = -R Og! (Vqy 9 (4) aS Vy aan’ MD) 954 (8) RET J 





(42) 
m-l ~{ ‘ll 
J = o'(0) V55 6(0) + os say’ (m-2)6[ 24]. m—-1 
{= ) 
m-l m-l 
(=4] ; ae a, eae a 
‘4 a oa \ = Me GEL a (m-1)° (43) 


how Meine Inteevalo in tCie™optimal control law and cost 
function of equations (5) and (11) can be approximated by 


binine SUMmMalionse aseiollows.: 





m-1 : 
uk(t) & RL ct ky x(t) + Pe K, {=he4)) xf - AI ES 2s 


ial - 
J 41(0) Ky o(0) + 29°C0) | , [-ES2] of =4] = 





nied Sl ee -i). il 
7) L ° at Ko| cma | f= 


ai 





Recall mite chav equations (12) and) (17) state that 


y,(t) = «{t - 453] Pea 2. ee 


then each term in equations (42-43) corresponds to a term in 


(44U-4H5), This correspondence strongly suggests 


= = ee ee 
peel = K, | m—1 | m—1 
-y (2G) -G-1)) . 1 
ae Res? win 


Assuming the validity of equations (46), one can now approxi- 
mate the optimal control law for delayed-differential 
Sala tuo omiiveallLl bias the Optimal control Tormulation, for 
ordinary differential systems. 

Ss. Equivalence 

The validity of equations (46) and their equivalence 

pemnOSscee S™icpOluULJOnN Can be proven by noting that the Riccati 
Sal Heum JP VhChenOSSmUG ll i gesmmo Gehicrane his Solution is 
identical to the Riccati equation (37) used to generate the 


qitinerentialssoluvion. 


E. ADVANTAGES OF THE DIFFERENTIAL APPROACH 

There are certain advantages to be gained by using the 
adifferential approximation scheme in calculating the optimal 
control Jaw for delayed-differential systems. 

Ticrotemrnome | OSea  oOopsemeenvalues Of theyapproximating 


i rorenietamemsystem yield information about the quality of 
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ioe | cCrotb co map prox! Mmabaon,.. and about the stability 
enaracteristics of thesactual, optimally controlled delayed- 
differential system. As Hess [25] points out, the largest 
closed loop damped. natural frequency of the differential 
cn cNOulLd temomammewhnen compared to the frequency of 
occurrence of the station points Ree ial, weleyGespatabiahes ge) 


through met) in (13). This means ensuring that 


Ww. 


RD eG j=l eeueeeen em (47) 


where Ww 1 Sica Silden em monic Mae inary pert eer the ae 


closed loop eigenvalue. The smaller the left hand side of 
equation (47), the more accurate are the forward difference 
expressions for sae) through CE dees lee Ce 
restrictions of equation (47) are met, the closed loop 
Cm ey oc cme ne sel terenulalesvsrem Bive excel lent’ 
DiiTornavtoumgoccardineg the Stability characteristics of the 
actual, optimally controlled delayed-differential system. 
second, the differential approach is amenable to systems 
with time varying parameters. This means that one should be 
poe von ! i ideatimeoPprOximattoen to che: optimal control law for 


a delayed-differential system of the form 
M(t ywed A(t) x(t) $8BCt) xl Wt) ]+ C(Z) u(t) 


SUDnleCcummeome COStErUNec ETON or the form 


eg 








CC Ca peal Mina ComaCey x(t) emma (a) R(t) u(t) Jat 
0 


pyeuuMEEZIne bone theory Of Optimal control of ordinary time 


varying differential systems. 


F., ALGORITHM FOR RESTRICTED FEEDBACK 
een ce eOduC Udon 
The optimal control law (5) may require a digital 
SeonDuucr storeimolemenzatrton. The question naturally arises 
as to just how well the system (1) would perform with a 
simpler, suboptimal control law. For example, for systems 
in which the time delay is relatively small, a control law 


Ol mule et OL 
wie oS -G, x(t) (48) 


Nayeyicrmd sags aclory performance, and be much easier to 


implement than control law (5). If law (48) is not 


satisfactory 

i OC a= Gy 2502) = G, x(t-1) | (49) 
or 

u(t) = -G, x(t) - G., x(t-) - G. x(t-1) (50) 


Mla Shige pew conc .dered wm heanext ssection offers agdirect 
constructive procedure for determining the G, in (48-50) 
based upon the optimal formulation (5). 
e. Restricted Feedback 
The method to be described is based upon the same 


linear approximations for the states of the delayed-differential 
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system as used in the differential approximation (13). The 
procedure involves representing x(t+®@) in (5) by any number 
of straight line segments as follows: 

Zeroth approximation 

Mesto a k(t) % 0<6<-l 

First approximation 

x(t+6e) = x(t) + [x(t) -x(t-l) Je, O0<@e<-l 

Second approximation 


meCt+O) = x(t er 


an , O26 ae 
x(t4e) a x(t) + (ER RA) (64) 5 co nl 
Third approximation 

m( tte) <s x(t jet pC) eA) : 0<6 <-l4 


x(t+e) = x(t-'4) + pe) READ o4 5) » ~/3 <9 -*% 


x(t+e) = x(t-%%) + pee) = X16 42%) , -%<0< -l 


Spl 





aol weamconurollayw based Upon any “one of these 
approximations can be computed by substituting one of the 
above expressions for x(t+g@) into the integral expression 
Maumee Opeima becenurol law (5). For example, wsing the 


second approximation 


0 | 
ue(t) = -RoT ot (Ky x(t) + Jf K,(6){x(t) + 20x(t) - x(t-%) J} 48 
mi 


1 
2 


ri | K, (8) {x(t-) + 20x(t-%) - x(t-1) ](6+3,) 146] 
which yields 


0 
v*(t) = “Rh Gt {EK 4 ( (1 +20) K, (6) de] x(t) 


2 


0 -}5 
+ {- f 26 K,(8)de+ f (2+26) K,(8) a8] x(t-¥) 
- -] 


av 


rai | a #20) K, (8) de] x(t-1)} 


-G, x(t) - a, x(t—4s) - G., x(t-1) 


X 


Since K, and K, (8) have already been calculated, the expres- 
Sions above can be numerically integrated to yield a 
SiMpldini.ed sssubeptimal control law. 

The performance of the delayed-differential system 
with any of these suboptimal control laws depends, of course, 


upon how well the straight line approximations represent 
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x(t+6). In this light, if a suboptimal law based upon the 
zeroth approximation yields a pe cane Pearce valic Of 
the cost function than the optimal law, a higher order 
approximation (rather than a different value of G,) is 
needed. The large increment in the cost function is 


mies caving Chav 
toi eC es 0<0<-1l 


1S MAOt a satisfactory approximation. 
oe See bisrryewenasCOSe Function Hvaluation 
iimorniaceon about Che stability of the suboptimal 
control law can be obtained from the closed-loop eigenvalues 
or theldittercuittal system as outlinied in Section I1l. E. 
Thiewecoslv Tunctuom can be fvaluatled either directly from 
Simulation or in approximate fashion by using expressions 


Smelar to (20—cil) : 


es 





IV. SAMPLE CONTROLLER DEVELOPMENT 


Peo toLL NMS LO BE STUDIED 


The scalar equations 


seGE |) as, x(t) + b,4x(t-1)+c¢,, u(t) (51) 
Gee SP Lp as io cs 0 (52) 
2 2 
J f Reo) ae Ge) at (53) 
0 
were studied for a4, = Day + -0,,5 -1 (Case 1) and 
ai1 5 Day , as =2 (Case 2). 


POrmeaScmmmCONCmregulred order of the differential 
SOOO dls vlowWe was moevermined GO ber vem: for Case 2, the order 
a reo Ommom Oe Olt L Cen mo lnese Values for m insured 
that we/(2n(m-1) ) ee a EO Rae? RR erro 

Uiee Gd ieee Lal ApproximaviLons , e€xpressed in macrix 


moLatlilon are: 


Ge) MEW GE) Pepe BUS) Neat) ae (54) 
y(0) = @ (55) 
Jo= f (y(t) Ay y(t) 4 u*(t) at (56) 
ayy 0 eek tes ee 0 Day 
(m-1) —-(m-1) .. . 0 0 
A, = C51) 
0 (m-1) eo 0 0 
0 0 , (m-1) -(m-1) 
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Cy! = [e1, CO pee On 0.) 

$¢' = [1 (m-2)/(m-1) .. . (m-1-1)/(m-1) . . . 0], 
lt 0 0 
0 0 0 

%® = 
0 0 0 


B. FORMULATION OF THE OPTIMAL CONTROL LAW 

The optimal control law for the delayed-differential 
system (51-53) was obtained by utilizing the differential 
approximation (54-56). The matrix Riccati equation (19) 
Lonmeunc Oui tomontial approximation was solved and the resulting 


Vs lscamuco delermine Ko and K, (8) via 


Ry = Vad 


oa 2 — ws 
«(4 = (m-1) Vio s49 10) eee ae a) 


K,(-1), not normally available from the differential approach, 


was obtained from Ross's solution (equation (34)) as 


K,(-1) = bi, Ky 


The resulting K K, (8) and cost function values are shown 


0? 
in Figures 1 and 2 for Cases 1 and 2 respectively. Figure 3 
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shows x(t) for the uncontrolled and optimally controlled 
delayed-differential system for Case 1. Figure 4 presents 
Phe Optimal control function, u*(t), for Case 1. Figures 


peonomomschowecimi lar results for Case 2. 


C. FORMULATION OF A RESTRICTED FEEDBACK CONTROL LAW 
Suboptimal control laws were developed for feedback of 

eas eelcvedmcouNOnesSlaLe Valiapdies assiociatedywith the 

differential approximation (51-57) by the method presented 


ijt tlie hee. These centrol laws are: 


Zeroth approximation 


Case J 

u(t ) Fee. 216 x(t) 
p25 Ce 

u(t) = -.196 x(t) 


First approximation 


C25 Cm 

Wie S40 (Gb) F [123 x(t=1) 
Case 2 

WG eee. 109 X(G) + .2ls x(t—-1) 


second approximation 


Case l 

thee = —-,384 x(t) + .0887 x(t-4) + 079 x(t-1) 
CaS Cae 

ie een CG) +e, IS xtt—-@ +. 155 x(t—1) 
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Third approximation 


Case l 
DGtpmeewta soe 5 Cl) + merisod x( Ge. 33) 4+ .0803 x(t-. 67 ) 
+ .0570 x(t-1) 
Case 2 
Mere oe) + eet x(t. es)+ . 120 x(t—.67) 


pte 115 x(t—1) 


iene Ue MOurr nem COSUs IMNcCulon VS LHe Number Of states 
in the restricted feedback is presented in Figures 7 and 8 
for Cases 1 and 2, respectively. Figure 9 presents x(t) for 
the delayed-differential system of Case 1 with no control 
Sidi Loe ece@hincOlmelaw determined Lrom Lhe third approxi— 
mation above. The control function for the third approxima- 
tion is shown in Figure 10. Figures 11 and led present 
Si or eootllvomnoie Case 2. tn bObR cases = the use of a 
fourth state in the feedback (third approximation) produced 
less han a seme percent improvement in the valwe of the cost 
HUN CiEal OM ¢ 

In order to compare the restricted feedback gains 
bd eo Oy waitcma | fOrlshm On Seetlon ETELF.2 with optimal 
gains associated with feedback composed of one and two 
states, a gradient optimization technique was mechanized. 
In this technique, equations (20) and (21) were solved 
recuysively to yield the optimum values of the restricted 


feedback gains for the differential systems of Cases 1 and e. 


Mnewomeimucient method for accomplishing this opti- 
i 2 eomemecammme round ian Ref. 32. 


Sit 





A check was then made to ensure that these gains were the 
Opviliaihmcesulmebwed TeCeCdbeck Gags Tom the actual delayed- 
differential system by direct integration of equations (51) 


and (53). The results are 


Case 1 
u(t) = ~.300 x(t) 
JI = .39240 
Case 2 
u(t) = ~.500 x(t) 
or 3729 
Case 1 
Wi) = te 330 X(t) + 2130 x(t—1) 
am 3 3/104 
Case 2 
) = —-,400 x(t) + .225 x(t-1) 
J = 3314 


Comparison of these results with those obtained from the 
ZeEVrevli ang tarts Order approxamationsg indicate that the 
algorithm was moving the restricted feedback gains in the 
right direction as the order of the approximations was 
BICrOATCO mene Utalaty Olmthe aleoracthm istalso borne four 


by Figures 7 and 8. 
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V. CONCLUSIONS 


hveercsearenm Nas shown thac the optimal control law for 
a delayed-differential system can be determined To any 
Mesimed accuracy from the optimal control law for an ordinary 
aqifferential system. Since the theory associated with 
differential systems is well established, and efficient 
algorithms for the required computations are readily 
available, this approach’‘has obvious merit. 

Further, it has been demonstrated that a simple algorithm 
Can be USEd vo determine a suboptimal, restricted feedback 
control law. 

where Hosed Hoop eigenvalues of the differential approxi- 
mation can be used to yield information about the conver- 
Bence of Che approximation. Aithough these eigenvalues 
eomp letelysdetermmme the stabllity of the differential 
approximation, they Carereby Lit ctemompeit. strongly , that 
PeMemiecs il hetpy seomerol lawewiltlwmeoauce 4a staple delayed— 
Gifferential wystem. Further research is required to 
ascertain the conditions under which a control law determined 
by this method will definitely produce a stable delayed- 


differential system. 
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